Rhythm of Motion Extraction and Rhythm-Based Cross-Media Alignment for Dance Videos

Author

Abstract

We present how to extract rhythm information in dance videos and music, and accordingly correlate them based on rhythmic representation. From dancer's movement, we construct motion trajectories, detect turnings, and stops of trajectories, and then estimate rhythm of motion (ROM). For music, beats are detected to describe rhythm of music. Two modalities are therefore represented as sequences of rhythm information to facilitate finding cross-media correspondence. Two applications, i.e., background music replacement and music video generation, are developed to demonstrate the practicality of cross-media correspondence. We evaluate performance of ROM extraction, and conduct subjective/objective evaluation to show that rich browsing experience can be provided by the proposed applications.

Source

IEEE Transactions on Multimedia 14.1 (2012): 129-141

Comments

ダンス映像や音楽信号のリズム情報を抽出

URL

Tag